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Description 

[0001] This invention relates in general to computer 
soft-ware, and in particular to a method and apparatus 
for inserting a place mark in an electronic mail item s 
which allows a multi-media system to access a refer- 
ence indicated by the place mark. 
[0002] The use of on-line publications systems and 
electronic mail systems is rapidly increasing. For indi- 
viduals in an organization, the use of an electronic mail 10 
system is useful for sending notes, messages, letters, 
etc., within the same office or across the country. Simply 
by entering information into an electronic mail screen, 
one person can electronically send that information to 
another person for immediate review or action. is 
[0003] Additionally, with the access to many on-line 
data-bases which provide information such as, for 
example, airline schedules, weather, stock reports, 
news articles, etc., users of a terminal have many refer- 
ences literally at their fingertips. It is a simple matter for 20 
a user to call up an on-line service to obtain a copy of a 
reference contained therein for review. 
[0004] If a first user desires to send a message along 
with a reference from an on-line source to another per- 
son, it is currently necessary to either type the entire 25 
information from the reference into the note, or type in 
identifying information to allow the recipient to locate the 
reference in the on-line service. If the text of the refer- 
ence is typed into the message, the system ends up 
storing multiple copies of the information which wastes 30 
disk, tape, or permanent storage space. If identifying 
information to locate the reference is entered into the 
message, the recipient must exit the processing of the 
mail to go the on-line publications system to locate and 
view the reference. In either case, it is wasteful effort for 35 
both the sender and the recipient. The following publica- 
tion describes various approaches to allow a recipient of 
an e-mail text document to view a reference: Computer, 
Vol 24, N°1 0 Oct. 1 991 , Los Alamitos, US, pages 58-67, 
M. Palaniappan & G. Fitzmaurice "Internet Express: An 40 
Inter-Desktop Multimedia Data-Transfer Service". In 
one of these approaches a transfer transaction is initi- 
ated by a user by sending via electronic mail information 
about the location of a document. To access the docu- 
ment, the recipient has to mount the file system on 45 
which the document resides.Once the file system is 
mounted, the recipient is required to enter the file sys- 
tem to access the document. Once connected to the file 
system, the recipient is also able to browse any other 
document which resides thereon. Such solution so 
imposes burdens on the user and raise security con- 
cerns as the recipient has the potential ability to modify 
or deposit documents once connected to the file sys- 
tem. In addition, problem may arise if a receiver does 
not retrieve the document immediately in case the doc- ss 
ument has been moved, renamed or modified. 
[0005] Thus, there is a need for a method and system 
for electronically linking an electronic mail item to a 



remotely stored reference available from a separate on- 
line publication service. An automatic connection to the 
separate on-line publication service and an automatic 
search of the remotely stored reference is conducted. 
A user enters a symbol to represent a place mark in a 
note or message which would refer to an on-line publi- 
cations system reference and sends the note to a recip- 
ient. A predefined reference identification information is 
entered into the place mark to establish the electronic 
link from the mail item to the separate on-line publica- 
tion service and the remotely stored reference through 
the place mark. The recipient of the mail item would 
then be able to select the place mark during viewing of 
the electronic mail.An automatic connection to the on- 
line publication service is established and an automatic 
search of the remotely stored reference based upon the 
predefined reference identification information is con- 
ducted. After viewing the selected on-line reference, 
control is returned to the electronic mail facility. 
[0006] The present invention, as claimed, provides a 
method and apparatus for linking an on-line reference 
and an electronic mail item which eliminates or substan- 
tially reduces problems in the prior art. The present 
invention allows a recipient of an electronic mail item to 
automatically present an on-line reference identified in 
the mail item without having to back out of the mail and 
enter the on-line service. In addition, sender effort is 
reduced by not requiring the manual typing of the refer- 
ence into the mail item. 

[0007] In accordance with one aspect of the present 
invention, a method of providing an on-line reference 
with an electronic mail item is disclosed. An on-line ref- 
erence is designated in the mail item with a place mark. 
The mail item and the place mark, but not the reference, 
are then transmitted to a recipient. The recipient may 
then review the reference while in the mail by selecting 
the place mark. The on-line service is then automati- 
cally called and the reference therein is presented for 
the recipient. Upon completion of the recipient review, 
control is transferred back to the mail system. 
[0008] It is a technical advantage of the present inven- 
tion that a user does not have to manually type a refer- 
ence into a mail item. It is a further technical advantage 
of the present invention in that storage space is saved 
by not having duplicate copies of a reference. It is a fur- 
ther technical advantage of the present invention that 
the recipient of a mail item with a cited reference is not 
required to back out of the mail service and enter the 
on-line service to review a cited reference. 
[0009] For a more complete understanding of the 
present invention and the advantages thereof, reference 
is now made to the Detailed Description taken in con- 
junction with the attached Drawings, in which: 

Figure 1 is a schematic illustration of a data 
processing system in accordance with the present 
invention; 

Figure 2 is a graphical representation of the use of 
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the present invention; 

Figure 3 is a flowchart depicting place mark crea- 
tion; 

Figure 4 is a flowchart depicting place mark inser- 
tion; and 5 
Figure 5 is a flowchart depicting place mark usage. 

[001 0] Referring to Figure 1 , there is depicted a graph- 
ical representation of a data processing system 8 which 
may be utilized to implement the present invention. As 10 
may be seen, data processing system 8 may include a 
plurality of networks, such as Local Area Networks 
(LAN) 10 and 32, each of which preferably includes a 
plurality of individual computers 12 and 30, respectively. 
Those skilled in the art will appreciate that a plurality of is 
Intelligent Workstations (IWS) coupled to a host proces- 
sor may be utilized for each such network. As is com- 
mon in such data processing systems, each individual 
computer may be coupled to a storage device 14 and/or 
a printer/output device 1 6. 20 
[0011] The data processing system 8 may also 
include multiple mainframe computers, such as main- 
frame computer 18, which may be preferably coupled to 
LAN 10 by means of communications link 22. The main- 
frame computer 18 may also be coupled to a storage 25 
device 20 which may serve as remote storage for LAN 
10. Similarly, LAN 10 may be coupled via communica- 
tions link 24 through a subsystem control unit/communi- 
cations controller 26 and communications link 34 to a 
gateway server 28. Gateway server 28 is preferably an so 
individual computer or IWS which serves to link LAN 32 
to LAN 10. 

[001 2] With respect to LAN 32 and LAN 1 0, a plurality 
of documents or resource objects may be stored within 
storage device 20 and controlled by mainframe compu- 35 
ter 18, as resource manager or library service for the 
resource objects thus stored. Of course, those skilled in 
the art will appreciate that mainframe computer 18 may 
be located a great geographic distance from LAN 10 
and similarly, LAN 10 may be located a substantial dif- 40 
ference from LAN 32. For example, LAN 32 may be 
located in California, while LAN 10 may be located 
within Texas, and mainframe computer 18 may be 
located in New York 

[001 3] Referring to Figure 2, a computer screen 39 is 45 
shown with an embodiment of the present invention rep- 
resented thereon. As is typical, a plurality of graphical 
objects 40, such as icons, are arranged on the screen 
39. A plurality of windows opened on the screen 39 for 
implementation of the present invention are also shown, so 
Represented by windows 42 and 44 are music audios 
which have been started and subsequently stopped. 
Similarly, windows 46 and 48 represent videos which 
have been started and subsequently stopped. In 
accordance with the present invention, whenever one of ss 
the windows 42, 44, 46, or 48 are stopped, pop-up win- 
dows (as are known in the art) are presented to the 
user. The user must answer appropriate information 



(such as, for example, a user supplied description and 
start/stop points) into the pop-up window. The user then 
selects the named reference as a place mark. 
[0014] After indicating that the named reference is to 
be used for a place mark, a place marks list window 50 
is created. The window 50 includes a place mark sym- 
bol such as, for example, musical note 52 and video 
symbol 54, along with the user selected name for the 
place mark. 

[001 5] In the implementation of the present invention, 
after the items have been inserted into the place mark 
list window 50, a user may then incorporate the multi- 
media information into an. electronic mail item. In the 
example shown in Figure 2, a correspondence editor 
window 56 is shown. The user has typed an electronic 
mail note to a recipient and has included therein two 
place marks. During the entry of the text into window 56, 
the user may drag the place mark symbol and corre- 
sponding user name to the appropriate place in the text. 
For example, the user has dragged the symbol and 
name Hawaii Seascape, generally identified by the ref- 
erence numeral 58, and the symbol and user name 
Mozart Piano Number 4, generally identified by the ref- 
erence numeral 60, to the text in the window 56. Upon 
completion of the electronic mail note in the window 56, 
the user may then send the note to a recipient. Upon 
receiving the note, the recipient may select (by any 
appropriate method such as clicking on the symbol with 
a mouse) the place mark and the on-line referenced 
multi-media material identified therein will be automati- 
cally called and presented to the recipient. Upon com- 
pletion of the review of the multi-media object by the 
recipient, control will be transferred back to the elec- 
tronic mail item for continued use thereof. 
[001 6] Referring to Figure 3, a flowchart illustrating the 
creation of a place mark is illustrated. The present 
invention starts at 80 and a multi-media object is 
selected at block 82. Linkage is established to the multi- 
media object at block 84. The multi-media object is then 
run at block 86. At decision block 88, it is determined 
whether or not to pause. If the response to decision 
block 88 is no, it is determined whether or not to stop at 
decision block 90. If the response to decision block 90 is 
yes, the present invention stops at 92. If the response to 
decision block 90 is no, the present invention returns to 
block 86 to run the multi-media object. Returning to 
decision block 88, if the response thereto is yes, a user 
title is added at block 94. A place mark is created at 
block 96 and placed in storage 98, followed by a return 
to run the multi-media object at block 86. 
[001 7] Referring to Figure 4, a flowchart illustrating the 
insertion of a place mark is shown. The present inven- 
tion starts at 100 followed by a request to start creation 
of a note at block 1 02. At block 1 04, text is entered into 
the note. At decision block 106. it is determined whether 
or not a place mark is to be added. If the response to 
decision block 106 is no, it is determined at decision 
block 1 08 whether or not to end the note. If the response 
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to decision block 108 is yes, the present invention stops 
at 1 10. If the response to decision block 108 is no, the 
present invention returns to block 1 04 to continue enter- 
ing text. Returning to decision block 106, if the response 
thereto is yes, a list of place marks is requested at block 5 
112. The list is displayed at 114 and a place mark is 
selected from the list at 116. The place mark is then 
inserted in the note at block 118 followed by a return to 
block 104 to continue entering text. 
[0018] Referring to Figure 5, a flowchart illustrating the 10 
use of a place mark is shown. The present invention 
starts at 120 followed by an opening of the mail reposi- 
tory at block 122. At block 124, a note is selected for 
reading. At block 126, the note is read followed by deci- 
sion block 128 where it is determined whether or not to 15 
view a place mark. If the response to decision block 128 
is no, it is determined at decision block 130 whether or 
not to end the note. If the response to decision block 
130 is yes, the present invention stops at 132. If the 
response to decision block 130 is no, the present inven- 20 
tion returns to block 126 to continue reading the note. 
Returning to decision block 128, if the response thereto 
is yes, a place mark is selected at block 134. It is then 
determined at decision block 136 whether or not there is 
access to the multi-media object identified in the place 25 
mark. If the response to decision block 136 is no, an 
attempt is made to link to the multi-media object at block 
138. It is determined at decision block 140, whether or 
not an error is detected. If the response to decision 
block 1 40 is yes, an error message is produced at block 30 
1 42 followed by a return to block 126 to allow continued 
reading of the note. If the response to decision block 
1 40 is no, it is determined at decision block 144 whether 
or not the multi-media object is the same version as in 
the place mark. Similarly, returning to decision block 35 
136, if the response thereto is yes t the decision block 
144 is directly accessed therefrom. If the response to 
decision block 1 44 is no, an error message is created at 
142, as previously discussed above. If the response to 
decision block 144 is yes, the place mark place in the 40 
multi-media object is located at block 146. The multi- 
media object is then played at block 148. At decision 
block 1 50, it is then determined whether or not to pause. 
If the response to decision block 150 is no, the multi- 
media object continues to play at block 148. If the 45 
response to decision block 150 is yes, it is determined at 
decision block 152 whether or not to end the multi- 
media presentation. If the response to decision block 
152 is no, the multi-media object resumes play at block 
148. If the response to decision block 152 is yes, the 50 
present invention returns to decision block 128 where it 
is determined whether or not to view a place mark as 
previously described above. 
[001 9] In summary, the present invention provides an 
improvement over the prior art which saves both user 55 
time and system storage. By utilizing the present inven- 
tion, a user may insert place marks into an electronic 
mail item that do not require manual typing or sending of 



the entire reference. Similarly, a recipient is not required 
to exit the electronic mail item and enter an on-line sys- 
tem to review a reference. A user now need only insert 
the place mark and the recipient may then call the refer- 
enced item by selecting the place mark. 

Claims 

1. A method for electronically linking an electronic 
mail item to a remotely stored reference available 
from a separate on-line publication service, com- 
prising the step of inserting a symbol representing a 
place mark into the electronic mail item, said sym- 
bol indicating a desired location in the electronic 
mail item for a recipient to view the remotely stored 
reference; 

characterized by 

entering predefined reference identification 
information into said place mark in order to 
establish an electronic link from said elec- 
tronic mail item to the separate on-line publica- 
tion service and the remotely stored reference 
through said place mark; 

transmitting said electronic mail item, said sym- 
bol and said place mark but not said remotely 
stored reference to the recipient; 

selecting said symbol in the transmitted elec- 
tronic mail item; 

automatically connecting and searching the 
separate on-line publication service for said 
remotely stored reference based upon the 
predefined reference identification informa- 
tion in said place mark; and 

displaying said remotely stored reference for 
review by the recipient. 

2. The method of Claim 1 , further comprising the step 
of: 

returning control to said electronic mail item 
upon completing review of said remotely stored 
reference. 

3. A system for electronically linking an electronic mail 
item to a remotely stored reference available from a 
separate on-line publication service, comprising 
means for inserting a symbol representing a place 
mark into the electronic mail item, said symbol indi- 
cating a desired location in the electronic mail item 
for a recipient to view the remotely stored refer- 
ence; 

said system being characterized by 
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means for entering predefined reference 
identification information into said place 
mark in order to establish an electronic link 
from said electronic mail item to the separate 
on-line publication service and the remotely $ 
stored reference through said place mark; 

means for transmitting said electronic mail 
item, said symbol and said place mark but not 
said remotely stored reference to the recipient; 10 

means for selecting said symbol in the trans- 
mitted electronic mail item; 

means for automatically connecting and 15 
searching the separate on-line publication 
service for said remotely stored reference 
based upon the predefined reference identi- 
fication information in said place mark; and 

20 

means for displaying said remotely stored ref- 
erence for review by the recipient. 

4. The system of Claim 3, further comprising: 

25 

means for returning control to said electronic 
mail item upon completing review of said 
remotely stored reference. 

PatentansprOche 30 

1. Ein Verfahren zur elektronischen Verbindung eines 
elektronischen Poststucks mit einem entfernt 
gespeicherten Referenzverweis von einem separa- 
ten Online-Publikationsdienst, das den Schritt des ss 
EinfOgens eines Symbols, das eine Marke darstellt, 
in das elektronische Poststuck umfaBt, wobei das 
Symbol einem Empfanger eine gewunschte Stelle 
in dem elektronischen Poststuck anzeigt, urn den 
entfernt gespeicherten Referenzverweis anzuse- 40 
. hen; 

dadurch gekennzeichnet, da 3 

eine vordefinierte Identifizierungsinformation 
des Referenzverweises in die Marke eingege- 45 
ben wird, urn eine elektronische Verbindung 
von dem elektronischen PoststQck zu dem 
separaten Online-Publikationsdienst und dem 
entfernt gespeicherten Referenzverweis durch 
die Marke herzustellen ; so 

das elektronische PoststQck, das Symbol und 
die Marke, nicht jedoch der entfernt gespei- 
cherte Referenzverweis an den Empfanger 
Qbertragen werden; 55 

das Symbol in dem ubertragenen PoststQck 
ausgewahlt wird; 



mit dem separaten Online-Publikationsdienst 
fur den entfernt gespeicherten Referenzver- 
weis auf der Grundlage der vordefinierten 
Identrfizierungsinformationen des Referenzver- 
weises in der Marke automatisch eine Verbin- 
dung hergestellt und dieser gesucht wird; und 

der entfernt gespeicherte Referenzverweis 
dem Empfanger angezeigt wird. 

2. Das Verfahren nach Anspruch 1 , das weiterhin fol- 
genden Schritt umfaBt: 

die Ruckgabe der Steuerung an das elektroni- 
sche PoststQck nach Beendigung der Ansicht 
des entfernt gespeicherten Referenzverwei- 
ses. 

3. Ein System zur elektronischen Verbindung eines 
elektronischen PoststQcks mit einem entfernt 
gespeicherten Referenzverweis von einem separa- 
ten Online-Publikationsdienst, das Mittel zum Ein- 
fugen eines Symbols, das eine Marke darstellt, in 
das elektronische PoststQck umfaBt, wobei das 
Symbol einem Empfanger eine gewunschte Stelle 
in dem elektronischen Poststuck anzeigt, urn den 
entfernt gespeicherten Referenzverweis anzuse- 
hen; 

wobei das System gekennzeichnet ist durch 

ein Mittel zur Eingabe einer vordefinierten 
Identifizierungsinformation des Referenzver- 
weises in die Marke, urn eine elektronische 
Verbindung von dem elektronischen PoststQck 
zu dem separaten Online-Publikationsdienst 
und dem entfernt gespeicherten Referenzver- 
weis durch die Marke herzustellen; 

ein Mittel zur Obertragung des elektronischen 
Poststucks, des Symbols und der Marke, nicht 
jedoch des entfernt gespeicherten Referenz- 
verweises an den Empfanger; 

ein Mittel zur Auswahl des Symbols in dem 
ubertragenen Poststuck; 

ein Mittel zur automatischen Verbindung mit 
und dem Suchen nach dem separaten Online- 
Publikationsdienst fQr den entfernt gespeicher- 
ten Referenzverweis auf der Grundlage der 
vordefinierten Identrfizierungsinformationen 
des Referenzverweises in der Marke; und 

ein Mittel zur Anzeige des entfernt gespeicher- 
ten Referenzverweises fGr den Empfanger. 

4. Das System nach Anspruch 3, das weiterhin fol- 
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gendes umfaGt: 

ein Mittel zur Ruckgabe der Steuerung an das 
elektronische PoststOck nach Beendigung der 
Ansicht des entfernt gespeicherten Referenz- s 
verweises. 

Revendications 

1. Procede pour lier eiectroniquement un article de 10 
courrier eiectronique k une reference m6moris6e k 
distance disponible k partir d'un service de publica- 
tion en ligne s6par6, comprenant les Stapes consis- 
tant k insurer un symbole representant un 
marqueur dans Particle de courrier eiectronique, is 
ledit symbole indiquant un emplacement desire 
dans I'article de courrier eiectronique pour un desti- 
nataire afin de visualiser la reference memorisee k 
distance ; 

caracferise par les Stapes consistant k 20 

entrer des informations d'identif ication de refe- 
rence predefines dans ledit marqueur afin 
d'etablir une liaison eiectronique k partir dudit 
article de courrier eiectronique au service de 25 
publication en ligne s£par£ et k la reference 
memorisee k distance par TintermSdiaire dudit 
marqueur ; 

transmettre ledit article de courrier electron!- so 
que, ledit symbole et ledit marqueur mais non 
ladite reference mSmorisSe k distance au des- 
tinataire ; 

seiectionner ledit symbole dans I'article de 35 
courrier eiectronique transmis ; 

connecter et rechercher automatiquement le 
service de publication en ligne s£par6 pour 
ladite reference memorisee k distance sur la 40 
base des informations ^identification de refe- 
rence pr6def inies dans ledit marqueur ; et 

visualiser ladite reference memorisee k dis- 
tance pour revisuaiisation par le destinataire. 45 

2. Procede selon la revendication 1, comprenant en 
outre retape consistant k : 

retourner la commande audit article de courrier so 
eiectronique sur achievement de la revisuaiisa- 
tion de ladite reference memorisee k distance. 

3. Systeme pour lier eiectroniquement un article de 
courrier eiectronique k une reference memorisee k ss 
distance disponible k partir d'un service de publica- 
tion en ligne s£par6 t comprenant un moyen pour 
insurer un symbole reprSsentant un marqueur dans 



Particle de courrier eiectronique, ledit symbole indi- 
quant un emplacement desire dans Particle de 
courrier eiectronique pour qu'un destinataire puisse 
visualiser la reference memorisee k distance ; 

ledit sysfeme etant caracferise par 

un moyen pour entrer des informations d'identi- 
fication de reference predefines dans ledit 
marqueur afin d'etablir un lien eiectronique k 
partir dudit article de courrier eiectronique au 
service de publication en ligne s6par6 et k la 
reference memorisee k distance par I'interme- 
diaire dudit marqueur ; 

un moyen pour transmettre ledit article de cour- 
rier eiectronique, ledit symbole et ledit mar- 
queur mais non ladite reference memorisee k 
distance au destinataire ; 

un moyen pour seiectionner ledit symbole dans 
I'article de courrier eiectronique transmis ; 

un moyen pour connecter et rechercher auto- 
matiquement le service de publication en ligne 
s6par6 pour ladite reference m6moris6e k dis- 
tance sur la base des informations d'identifica- 
tion de reference predefines dans ledit 
marqueur ; et 

un moyen pour visualiser ladite reference 
memorises k distance pour revisuaiisation par 
le destinataire. 

4. Systeme selon la revendication 3, comprenant en 
outre : 

un moyen pour retourner la commande audit 
article de courrier eiectronique sur achievement 
de la revisuaiisation de ladite reference mSmo- 
risee k distance. 
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